1 


V * ^ ^ ^ 

Radiance and Jacobian intercomparison of radiative transfer models 

applied to HIRS and AMSU channels 


by 

L. Garand', D. S. Turner 2 , M. Larocque 1 , J. Bates 3 , S. Boukabara 4 , P. Brunei 5 , F. Chevallier 6 , G. 
Deblonde', R. Engelen 7 , M. Hollingshead 8 , D. Jackson 3 , G. Jedlovec 9 , J. Joiner 10 , T. Kleespies , 
D. S. McKague 8 , L. McMillin 11 , J.-L. Moncet 4 , J. R. Pardo 12 , P. J. Rayer 13 , E. Salathe , R. 
Saunders 13 , N. A. Scott 15 , P. Van Deist 16 , and H. Woolf 16 . 


Submitted to JGR , November 17, 2000 


'MSC, Dorval, Qc., Canada 
2 MSC, Downsview, Ont„ Canada. 

3 NOAA/ERL, Boulder, CO. 

4 AER, Cambridge, MA. 

5 Meteo-France, Lannion, France. 

6 ECMWF, Reading, U.K. 

7 Colorado State Univ., Fort Colllins, CO. 
8 Raytheon, Aurora, CO. 

9 NASA/MSFC, Hunstville, AL. 
l0 NASA/DAO, Washington, D.C. 
n NOAA/NESDIS, Washington, D.C. 
l2 Califimia Institute of Technology, Pasadena, CA. 
13 Met. Office, Bracknell, U.K. 

,4 Univ. of Washington, Seattle, WA. 
i 5 CNRS/LMD, Palaiseau, France. 
l6 Univ. of Wisconsin, Madison, WI. 

Corresponding author address: Dr Louis Garand, 
Meteorological Service of Canada (MSC) 

2121 Trans-Canada Highway, Dorval, Qc, 

Canada, H9P1 J3. 

Email: louis.garand@ec.gc.ca 


2 


Abstract 

The goals of this study are the evaluation of cunen, fas, radtative transfer models (RTMs) 
and line-by-line (LBL) models. The intercompanson focuses on the modelmg 

H,RS (High-resolution Infrared Sounder) and 4 AMSU (Advanced Microwave Sound, ng 

Uni,, channels, .n.eres, in this ,opic was ev.denced by ,he participation of 24 sc, ends, s 

from ,6 institutions. An ensemble of 42 di verse atmospheres was used and results 

compiled for 19 infrared models and 10 microwave models, including several LBL RTMs. 

, „nlv radiances but also Jacobians (of temperature, water vapor and 
For the first time, not only radiances, oui 

ozone) were compared to various LBL models for many channels. 

the infrared, LBL models typically agree to withtn 0.05-0.15 K (standard dev, a, ion) m 

t erm s of ,op-of-,he-a,mos P here bnghiness temperature (BT). .ndiv.dual differences up ,0 

, lo Qnrt linked to the type of atmosphere in 
0.5 K still exist, systematic in some channels, an 

J , i t «in| BTs to within 0.25 K, but no model achieves 
others. The best fast models emulate LBL B 

this desirable level of success for all channels. The ozone modeling ,s particularly 
challenging. In .he nucrowave, fas, models generally do qu.te wel, against the LBL mode, 
t0 which they were tuned. However si^ifican, differences were noted among LBL models. 
Extending the intercompanson to the lacoh.ans proved very useful m detecting subtle and 
more obvious modeling enors. In add,,, on, to, a, and stngle gas opt, cal depths were 
calculated, which provided additional insight on the nature of differences. 
Recommendations for future intercomparisons are suggested. 
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1. Introduction 


This work represents an initiative frotn the International TOYS Wording Group (ITWG). 
This group has been active in satellite meteorology since 1983, with formal conferences 
organized approx, mate.y every e.ghteen months. One of the important scientif.c 
objectives of ITWG is the optimal use of satellite data m global analyses 
improve weather foreeasts. Obviously, radiative transfer issues are critical in that acttv.ty, 

as they are in satellite remote sensing in general. 

For most remote sensing applications, notably the asshmlation of satellite radiances m 
near real tune, fast and accurate toward radtattve transfer mode, ,RTMs) which 
observed radrances are needed. In general, inversion techniques require an accompanying 
Jacobian routine to a gtven forward model. The Jacobian is the partial derivative of 
radiance with respect to the atmospheric parameter rnfluencing that radiance. The 
Jacob, an is fundamental in radiance assimt.atton as its magnitude and shape determine the 
magnitude and shape of the analysis increments (i.e. atmosphenc profile corrections to a 
firs, guess, Eyre et al, 1993). I, is therefore important to evaluate both the outgoing 

radiance and the Jacobians. 


Line-by-line (LBL) models effectively calculate the contribution of each absorbing line. 


and hence are computationally intensive. Fast RTMs on 

the broadband (BB) monochromatic-equivalent type in 


the other hand, are typically of 
that the integration over the 


instrument channel response is 


simulated directly and the transmittance is parameterized 
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using an LBL mode, as reference. A .bird class of models, of in.ennedia.e complexity 
between BB and LBL, is the “narrow-band” (NB). These models divide the spectrum into 

calculate fluxes, tak.ng into account the variation of the op, teal properties of the surface 
and clouds with wavelength. NB radiances can however be convolved with a satellite 
spectral response function to ge, a monochromattc-equivalen. radiance. While m pnnctple 
NB models should be more accurate than BB models, they are in general no. “tuned” to fit 
an LBL mode,. Most BB models use an ensemble of predictors ,0 compute 
transm, ttances. In most cases, the regression equations require fixed pressure levels. 
Recently, a few BB models were developed based on a physical formulation 
transmittance, simtlar or identical to those commonly used in radiation codes computing 
infrared fluxes in forecast or general circular, on model. These models operate on any 
vertical coordinate. Such physical parameterizations are also used by some NB models. 


There are two main goals in this study: first, to evaluate the ability of current fast models 
,o reproduce LBL model results, and second, to quantify the degree of agreement between 
LBL models themselves. In principle, LBL models using identical spectroscopic data 
should yield the same answer. However, LBL codes, as will be discussed further, are 
complex and not entirely free from approximations. Another inherent goal of this work is 
to present an extended methodology of validation aimed at precisely identifying the nature 
of the differences between models. This is accomplished by evaluating specific quantities 
such as level-to-TOA (top of atmosphere) transmit.ances and Jacobian profiles pertaining 


to various gases. 
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The United States National Oceanic and Atmospheric Administration (NOAA) satellites 
provide the ensemble of radiances most commonly used in numerical weather prediction 
(NWP) centers. The High-resolution Infrared Sounder (HIRS) has 19 infrared (IR) 
sounding channels (from 3.8-15 pm), and the Advanced Microwave Sounding Unit 
(AMSU-A and B) has 20 microwave channels (from 23.8-183.31 GHz). This study is 
comprehensive, as it covers both the infrared (IR) and microwave (MW) channels. Seven 
HIRS and four AMSU channels are evaluated. A very large number of plots and tables 
were generated from this experiment and have been made available on a web site (MSC, 
see acknowledgments). This paper completes the experiment with a summary of essential 
results. 

The participation in the intercomparison was strong: 24 scientists and 29 models, 

including several LBLs. This reflects the interest of the modelers or model users to know 
the strengths and weaknesses of the model they built, maintain or simply use as a research 
tool. From the viewpoint of LBL modelers especially, gaining confidence in their lengthy 
code is a major benefit. In fact, several modelers (including LBL) investigated early 
results from this study and found some deficiencies which could be corrected. Revised 
submissions were readily accepted since it is important to appreciate the strengths and 
limitations of the models when they operate as they should. However, some of the original 
submissions which contained subtle or more obvious deficiencies were retained for time 
considerations. The availability of LBL computations makes it possible for participants to 
pursue their investigation on the nature of differences. 
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The validation of radiance models is an ongoing process, as our knowledge of the 
spectroscopy improves and as new satellite channels become available. A decade ago, a 
major “Intercomparison of Radiative Transfer Codes in Climate Models” (ICRCCM) was 
accomplished (Ellingson et al, 1991). The Intercomparison of Transmittance and 
Radiance Algorithms (ITRA, Chedin et al, 1988) was also active for many years in 
radiance modeling and validation. Recently, a related validation exercise was completed 
by Soden et al (2000); hereafter S-2000. The focus of that study was the simulation of 
radiances sensitive to upper tropospheric humidity. Only one channel, HIRS-12 from 
NOAA-12, was examined. In this paper, the variety of channels studied (both IR and 
MW) makes the work more complex, and more emphasis is put on the validation of 
Jacobians. A multi-channel Jacobian validation involving LBL models is in fact 
accomplished in this study for the first time. Section 2 defines the parameters of the 
experiment and Section 3 presents the various models. Sections 4 and 5 provide IR and 
MW results, respectively, in terms of brightness temperature (BT), Jacobians and 
transmittances. Section 6 summarizes the article and suggests recommendations for future 
intercomparisons. 

2. Experiment definition 

2.1 Channel characteristics 

The channel selection was guided by the desire to evaluate RTMs in the various spectral 
regions covered by HIRS and AMSU. The seven HIRS channels represent temperature 
sounding channels, humidity channels and channels influenced by ozone. Three 
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temperature channels and one water vapor channel were selected from the AMSU 
channels. Tables 1 and 2 show the selected HIRS and AMSU channel characteristics, 
respectively. The HIRS channels are those from NOAA-14 and the AMSU channels are 
those from NOAA-15. Planck function routines were supplied to ensure BT differences 
between models would not be caused by the radiance to BT conversion. In addition, 
channel response functions were provided and the surface emissivity was set to unity for 
all IR channels and to 0.6 for all MW channels. 

2.2 Profile selection 

An ensemble of 42 diverse profiles was selected for the experiment. The first six are 
standard profiles (tropical, midlatitude summer and winter, subarctic summer and winter 
and US standard atmosphere, see Anderson et al, 1986). The remaining 36 profiles were 
selected from a bank of profiles defined by Turner (1995a). The 12 profiles 7-18 are 
ranked by increasing mean (mass weighted) atmospheric temperature. The next 12 (19- 
30) are ranked by increasing integrated water vapor and the last 12 (31-42) by increasing 
total ozone. This profile distribution should be kept in mind when interpreting results 
related to the profile number. Table 3 details the profile characteristics in terms of these 
three parameters and surface temperature. Concentrations for the following eight gases 
were provided: H 2 0, C0 2 (fixed at 360 ppmv), 0 3 , N 2 0, CO, CH 4 , 0 2 (fixed at .209 v/v) 
and N 2 (fixed at .781 v/v). All profiles were interpolated to 43 standard pressure levels 
which are the same as those used by the RTTOV (Radiative Transfer model for TOVS) 


model. These levels are listed in Table 4. 
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2.3 Requested quantities 

All participants were requested to provide for clear skies and nadir view the following 
quantities: 

a) TOA BTs for all channels and profiles 

b) level-to-TOA total, water vapor and, where appropriate ozone transmittances (HIRS 
2, 5, 9, 10) for all profiles 

c) Temperature, water vapor and, where appropriate ozone Jacobian profiles 

Jacobians were only requested for 5 profiles (6, 18, 19, 30, 31) due to the computational 
load for those models that do not have the accompanying analytical Jacobian routine. 
For such models, Jacobians are obtained by the perturbation method, which provides an 
excellent approximation for small perturbations. The perturbation method is costly: a 
Jacobian profile is obtained from 2 N BT calculations where N is the number of vertical 
levels. 

The temperature Jacobian J t i at level i is obtained by perturbation of the temperature T, 
at that level: 


J tj = BT (Tj + 0.5 K) - BT (T r 0.5 K) 


( 1 ) 
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Hence the temperature Jacobian expresses the BT change at the TOA due to 1 K change 
in atmospheric temperature at a given level. Similarly, the water vapor and ozone 
Jacobians J g ,, pertaining to gas g were defined as: 

J gi = BT (q, - 0.05 qi) - BT {q, + 0.05 q,) 

where q t is the specific concentration of the gas at level /. Thus J g , is not strictly a 
Jacobian: the left hand side of (2) should be divided by the perturbation 0.1 q to represent 
the Jacobian. Eq. (2) represents the change in BT (units K) due to a 10 % change in gas 
specific concentration (units kg/kg). Such a definition is easier to interpret for this 
comparison. Analytical q Jacobians were multiplied by -10 % q to be of the same units 
and sign as those obtained from (2). As defined here, temperature and water vapor 
Jacobians often turn out to be of similar sign and magnitude for channels sensitive to 
water vapor. Super-saturation does not occur in (2) as none of the profiles has levels 
with relative humidity beyond 95 %. 

There are two basic causes for inaccuracy of Jacobians: inaccuracy in the forward model 
and error in the actual coding of the Jacobian. The coding of the perturbation method 
(Eqs. 1-2) is straightforward. However, errors may still occur in the interpolation from 
fixed levels needed by most BB models to desired output levels. Coding of an analytical 
Jacobian is often not trivial, but efficient ways are used by modelers to test the validity of 
resulting codes, including the perturbation method. 
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ln a n ; d ea. intercomparison, Jacob, ans and transmittances for a,, intervening gases should 
normally have been computed, notably for CO ; . CHs, Or and NrO. This is no, a problem 
for LBL models. Even if the total transmittance in a non-monochroma, ic channel is not 
exactly equal to the product of the individual calculated transmittances (violation of the 
product rule due to polychroma, icity), an “equivalent" gas transmittance can be obtamed 
(McMilhn e, al, 1995). On the other hand, many of the current fas, models can provide 
water vapor and ozone transmittances only. The effect of other gases, assumed spatially 
and temporally invanant, is often parametenzed as a group. While Or and Nr may be 
constdered constant and well mixed, this is no, the case for COr, CH., NrO and CO, and 
using climatology for these gases introduces radiative transfer errors. Other important 
aspects no, considered in this study include the evaluation of downwelling radiances (and 
surface reflection), the effect of viewing angle on the accuracy of models, and vertical 
interpolation effects. Interpolation of transmittances from calculated to desired levels 
was done in optical depth space (negative of the log of transmittance). Interpolation of 
Jacob, ans was done by considering the pressure thickness of the layers. I, is in general 
difficult to separate interpolation errors from other causes of error. 

3. Participating models 


The 29 participating models, 19 IR and 10 MW, are listed in Table 5. The table specifies 
the model type (BB, NB or LBL) and indicates if the model is based on a physical 
transmittance formulation or if it is regression-based. The water vapor continuum 
parameterization is usually taken from a vers, on of Clough e, „/ (1989). Differences 
between the CKD2.1 and CKD2.2 versions are no, significant for the channels studied. 
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The spectroscopic database or the 


reference model on which the fast model was based is 


indicated. Final.y, the main reference is supplted. Some additional references to those of 
Table 5 are provided below with a brief description of the models. 

RTTOV-6 is the latest release (March 2000) of RTTOV; changes from RTTOV-5 were 
mainly made in the MW. This fas, model has an analytic Jacobian and is widely used in 
the ATOVS communtty. OPTRAN, also used in NWP, has similar charactenstics, bu, 
the vertical coord, nate is the absorber space rather than a fixed pressure space. RTTOV 
and OPTRAN are among the fastest models: a forward calculation on 43 levels on a 
supercomputer takes about 5 X 10-5 s in vectorized mode, and about 2-3 times that 
figure for the Jacobian. OPTRAN2 is a research vers, on using GENLN2 as opposed to 
LBLRTM transmittances to derive its regression coefficients. OP-GLN2 and OP LRTM 
are two additional versions of OPTRAN using different predictors and training profiles 
and which, again, are based on either GENLN2 or LBLRTM. MSCFAST (named 
AESFAST in S-2000) uses a physical formulation of transmittance based on the Goody 
random model (two parameters denved from the HITRAN-96 database). For each gas, a 
constant parameter, typically near unity, multiplies the optical depth to best fit the FLBL 
model. MSCFAST2 uses an additional pressure dependence factor on the optica p 
afTecting mostly HIRS 2 and 9. MALKMUS is another physical model based on the 
well known two-parameter transmittance formulation of the same name (along with 
HITRAN-96). MALKMUS is not tuned to an LBL, but to MODTRAN transmittances. 
GLATOVS (Susskind e, al, .983, Sienkiewcz, .996), HFFP (H.RS Fas, Fonvard 
Program, Joiner e, al, 1998) and SIMRAD (McMillin and Fleming, 1976) are other 
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regression models used in remote sensing. The latter is an old version which has not 
been modified substantial « is a narrowband mode, (NB) with resolutton of , cm". 
GLATOVS is also an old code no. fully adapted for this exercise: it used the response 
functton of correspond, ng H1RS channels from previous sate„,.es ,0 which was 
adapted. STREAMER is a NB model, but its spectral resolution vanes from 20 to 40 cm 
Th i s is a handicap for some of the channels under investigate which are nanower 
than this; no results were compiled for HIRS 2, 5 and 15 for that reason. The other NB 
model is MODTRAN which has a nominal resolution of 2 cm SYNSA 

classified as an LBL: it operates as such but it evaluates spectral means to a given 
accuracy using the random sampling method, resulting in a large reduction in computer 
time (Tjemkes and Schmetz, 1987). The other LBL models: FLBL, GENLN2, 4A (Scott 
and Chedin, 1981) and LBLRTM (Clough e, al, 1992) consider all lines (with a 
minimum strength and within the spectral range significant for a given channel). These 
complex codes were all written independently, except for some shared parameterizations 
such as those of the continue. The year 2000 version of 4A referred to as LBL4A.OO, 
(Scott, private communication) was found much closer to other LBLs than the previous 
vers, on (4A_93, Tournier e, al, 1995) originally submitted. Both versions of 4A share 
the same analytical approach for the Jacobian computation (Cheruy et al, 1995). A, the 


moment, 4A is the only LBL model providing analytical Jacobtans. 

LBL MW models are simpler than IR ones because the number of absorbing lines is less 
and the number of simultaneously active gases in most channels is limited to two, water 
vapor and oxygen. Most models use spectroscopic data from Rosenkranz (1975, 1998), 
Liebe (1989), Liebe et al (1992) and Barret and Chung (1962). Differences between MW 
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LBLs may occur from different sources of line data, different water vapor and dry-air 
continua and different line shape formulations, including line mixing. BB MW models 
typically work on fixed pressure levels. No MW NB models were submitted. AER_OSS 
however uses both BB and NB concepts by doing monochromatic calculations at a set of 
optimally selected frequencies as predictors for band-averaged transmittance. RTTOV 
MW computations were based on a version of the Liebe LBL model which included a 
scalar approximation to the Zeeman effect as defined in Liebe et al (1993). This scalar 
approximation used the maximum polar value of 60 T for the geomagnetic field for every 
profile. All other MW LBL model calculations did not include the Zeeman effect for this 
study (which only affects upper stratospheric channels) although most of them can 
compute it as an option. 

4. Infrared results 

4.1 Brightness temperature 

Table 6 presents BT results in terms of standard deviation (STD) and bias for the seven 
HIRS channels. As in S-2000, GENLN2 is used as reference. Since the STDs between 
LBL models are typically of the order of 0.1 K and at most 0.2 K, the choice of the 
reference has only a marginal impact on the evaluation of the results of fast models 
(results versus each LBL are available on the MSC web site). The accuracy sought for 
fast models is 0.25 K or better representing a marginal deterioration with respect to the 
assumed LBL accuracy (-0.10 K) or the instrument noise NEAT (which can be reduced 
by spatial averaging). Garand (2000) demonstrated the need for the highest possible 
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RTM and measurement accuracy in radiance assimilation, considering the relatively good 
quality of background estimates (e.g. temperature STDs against radiosondes of the order 
of 0.8-1. 1 K in the troposphere). It is also important to evaluate if the precision of the 
RTM deteriorates in specific types of profiles or air masses. 

Some of the biases listed in Table 6 exceed 2 K. These large biases appear to be of 
systematic nature: GLATOVS, SIMRAD and MODTRAN in HIRS-05; MALKMUS, 
STREAMER, OP_GLN2 and OP LRTM in HIRS-1 1. Biases of that magnitude may be 
caused by not tuning the fast models to a reference LBL model, spectral resolution that is 
too coarse, outdated spectroscopy, neglecting a contributing gas, incorrect convolution 
with the spectral response function, or some implementation error. 

RTTOV achieves the desired accuracy in most channels except for the water vapor 
channels 11-12 (STDs 0.42-0.55 K). It appears that RTTOV would benefit from an 
improved water vapor transmittance. The various versions of OPTRAN give accurate 
results in all channels, but no single version does this. For example the “official” 
OPTRAN gets poor results in HIRS-09 due to the fact that only six different ozone 
profiles were used in the dependent atmospheres, but OP GLN2 solves this problem with 
a more representative ensemble of training profiles. OPTRAN2, based on GENLN2, is 
slightly closer to that reference in HIRS-02, 5 and 15, and more significantly in HIRS-1 2. 
Thus the fast models appear to be sensitive to the reference that they are tuned against as 
well as to the choice of dependent atmospheres. The more advanced version of 
MSCFAST, MSCFAST2, gets very good results in most channels, notably water vapor 
channels. A weaker channel is HIRS-09, where MSCFAST2 has a BT STD of 0.31 K. 
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The other physical model, MALKMUS, gets STDs in the range 0.24 to 0.68 except in 
H1RS-09. MALKMUS would likely gain from a direct tuning of its transmittances to an 
LBL model. GLATOVS and SIMRAD are older codes which would require significant 
adjustments to be used in NWP. HFFP yields excellent results in five of the seven 
channels, with degraded performance in HIRS-09 and 10. SYNSATRAD obtains results 
similar to full LBLs, except in HIRS-09 where its ozone transmittance was found 
deficient (i.e. the sampling of ozone lines most likely requires revision). In general, BB 
and NB models often get excellent results, better than 0.25 K, but no such model is fully 
satisfactory in all respects. Fast models with transmittance formulation tuned to an LBL 
reference tend to be more accurate than those models which were not adjusted that way. 

A look at individual differences often reveals specific error characteristics. Fig. 1 shows 
BT differences with respect to GENLN2 of selected fast models for the 42 atmospheres 
and for six of the HIRS channels. The HIRS-02 plot shows the large improvement of 
MSCFAST2 (STD of 0.10 K) over MSCFAST (STD of 0.48 K) and the 0.5 K bias 
associated to SIMRAD. HIRS-05 is characterized by two groups of models, each about 
+/- 0.5 K off from GENLN2. Models based on LBLRTM, like OP_LRTM and 
OPTRAN, have a positive bias. Others, based on FLBL (MSCFAST2) or GENLN2 
(RTTOV-6, OPTRAN2) have a negative bias. HIRS-09 is the channel with largest spread 
among models. STREAMER has a large positive bias with important fluctuations in dry 
atmospheres. MALKMUS, OPTRAN and GLATOVS are also erratic. In HIRS- 10, 
differences pertaining to MALKMUS are clearly higher in warm and wet profiles (17-18, 
22-30). The same is true for RTTOV-6, with less amplitude and opposite sign: 


14 


differences are higher in profiles with integrated water content greater than 35 kg m . 
STREAMER gets largest differences in the two warmest profiles, 18 and 22. In HIRS- 
11, MALKMUS has a relatively uniform 2.5 K bias, but also exhibits peaks far from that 
mean value in the driest atmospheres: 8, 19, 31 and 42. In contrast to HIRS-10, RTTOV- 
6 differences appear random in HIRS-11 as well as in HIRS-12. In the latter channel 
OP GNLN2 represents a significant improvement over OPTRAN, but the ~0.7 K bias 
remains. MSCFAST2 and HFFP are closest to GENLN2, with STDs as low as 0.08 K in 
HIRS-12. 

A more detailed examination of LBL results is of interest. Understanding the cause of 
differences between LBL models is a complicated issue. Differences may be caused by 
factors such as spectroscopy, continuum parameterizations, methods of integrating 
vertically and spectrally, accounting of pressure and temperature effects, interpolation 
into pre-computed tables and spectral resolution (0.005 cm' 1 is typical). As in Fig. 1, Fig. 
2 shows BT differences between four LBL models and GENLN2 for the seven HIRS 
channels as a function of the profile number. In HIRS-05, nearly constant -0.5 K 
differences are noted for FLBL and +0.4 K for LBLRTM. As noted in Fig. 1 , this bias 
structure is reproduced by fast models. Excellent agreement is seen in HIRS-09, except 
for SYNSATRAD. Differences for that model were found to increase with higher BTs. 
Differences up to 0.3 K in HIRS-10 of LBL4A_00, FLBL and LBLRTM are clearly 
linked to the warmest and wettest profiles. In HIRS-11 LBL4A has a nearly uniform - 
0.25 K bias, and SYNSATRAD has largest differences in cold atmospheres (7-10, 31, 
36). In HIRS-12, GENLN2 is the outsider (differences up to -0.55 K), with all other 
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models packed together. Attempts to explain this discrepancy have not been successful 
yet, but the larger differences in warm atmospheres suggest temperature effects. The 
continuum parameterization is not a likely candidate for the differences since other LBLs 
used either the same one or a very similar version. In HIRS-15, LBLRTM and FLBL 
differ from GENLN2 in similar fashion, with biases up to 0.3 K, again larger in warmer 
atmospheres. Thus in general LBL differences as large as 0.5 K are often noted in HIRS 
channels, some of uniform nature, others more linked to the temperature structure. A 
more detailed investigation involving optical depth differences pertaining to individual 
gases would reveal additional information on the nature of differences. Some examples 
are provided in the next section. 


4,2 Jacobians and transmittances 


In order to objectively evaluate Jacobians, a goodness of fit measure, M, was defined as 


M = 100 

1 





(3) 


where J m and J r are the model and reference Jacobian respectively and the sum is over the 
number of levels, N. This measure can be seen as an overall percentage of error. With 
this normalization, values of M can be interpreted in a similar fashion for all channels. In 
practice, it is found that values of M below 5 indicate an excellent Jacobian fit, typical 
among LBL models; 5<M<\5 indicates a good fit, likely sufficient for NWP application; 
1 5<M<25 is fair to marginal, and M > 25 indicates a serious problem. This measure is 
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only indicative; visual inspection of the profiles certainly gives more clues on the nature 
of problems. Examination of Jacobians associated with a single profile is sufficient for 
illustration purposes. Profile 30 was chosen; it is a warm and wet profile. Table 7 
provides M values for profile 30 and for the various channels associated with either 
temperature, water vapor, or ozone Jacobian profiles. 

Representative HIRS Jacobian profiles are shown in Fig. 3. The figure allows to 
appreciate the spread between the various models and to identify outsiders. One can link 
the M values in Table 7 and the Jacobian profile characteristics in Fig. 3. GLATOVS 
produces some unphysical kinks in three of the profiles in Fig. 3. Profiles with kinks or 
noise will no doubt make convergence more difficult in data assimilation. An erratic 
behavior is also noted for OP-GLN2 in the HIRS-05 T Jacobian and for MODTRAN in 
the HIRS- 10 plot. Ozone Jacobians for HIRS-09 are clearly exaggerated for OPTRAN 
and OP-LRTM, resulting in large M values. These two models also display some 
spurious oscillations above 100 hPa in the HIRS-11 H20 Jacobians. This result may 
point to a weak conditioning of the regression at upper levels. This type of error is 
probably easy to eliminate. HFFP is an outsider in HIRS-05 T, and especially in HIRS- 10 
H 2 O ( M = 60.7) due to a reduced Jacobian amplitude. The RTTOV Jacobian amplitude 
and to some degree the peak position (notably for HIRS- 10 H 2 0) differ from the others in 
the HIRS 10, 11, and 15 plots, resulting in M values in the range 12-18. Finally the 
amplitude peak and position of HIRS-15 T Jacobians are slightly off for MSCFAST and 
MALKMUS. These few examples show that the Jacobian study allows the determination 
of minor and even more serious problems which otherwise would have been difficult to 
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detect. Values of M for LBLs are typically less than 10. Somewhat higher values are 
noted for LBL4A00. Jacobians for that LBL were found to have the right shape and 
amplitude, but with peaks slightly too high (~20 hPa) due to their evaluation in the 
middle of the layers (rather than at their boundaries). Except for the ozone Jacobian in 
HIRS-05, SYNSATRAD is remarkably close to GENLN2, with all values of M below 6.5 
in Table 7. 

A look at individual gas transmittances reveals specific information on the nature of 
differences. As an example, ozone transmittances are shown in Fig. 4 for HIRS 5 and 
HIRS 9. The spread becomes large below 50 hPa. RTTOV, GLATOVS, SYNSATRAD 
and MALKMUS appear as outsiders in HIRS-05 while the same applies again to the 
latter 3 models, MSCFAST and MODTRAN in HIRS-09. The OPTRAN and OP-LRTM 
transmittances become abruptly constant below 200 mb, which should not be the case. 
MODTRAN displays transmittances slightly increasing with pressure, which is non- 
physical. In general, outsiders in 0 3 transmittance are linked to largest 0 3 Jacobian M 
values in Table 7, as well as largest BT STDs in Table 6. 

Scatter plots of individual model optical depths versus GENLN2 optical depths (from 
each level to the TOA) are shown in Fig. 5 for HIRS-1 1 . This is a very convenient way to 
appreciate the quality of a transmittance formulation. GLATOVS has a low optical depth 
bias but the scatter is large. Among the fast models, OPTRAN is clearly the model 
closest to GENLN2; its scatter is very small. MODTRAN also displays a small scatter, 
but its optical depth are underestimated. A simple multiplication of optical depths by a 
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constant would remove most of that bias. High scatter on the other hand can only be 
reduced by major changes to the transmittance formulation. FLBL follows GENLN2 
almost exactly. The somewhat larger scatter of LBL4A 00 suggests that this model 
differs the most from other LBLs for water vapor transmittances. Since this scatter has no 
bias while that of total transmittance (not shown) indicates a slight overestimation of 
optical depths, one may speculate that the negative LBL4A 00 BT constant bias of -0.25 
K (Fig. 2) is caused by the second gas in importance: methane. This hypothesis could be 
ascertained by a look at methane transmittances, which were not available for this study. 

5. Microwave results 
5.1 Brightness temperatures 

Table 8 lists the microwave BT STDs and biases, using CIMSS MWLBL as the 
reference. This LBL model is in excellent agreement with AERLBL and in relatively 
good agreement with ATM. AER_OSS is derived from AER LBL and these two models 
are within 0.05 K of each other for all four channels. ATM shows some significant 
differences with CIMSS MWLBL in two channels: 0.19 K BT STD in AMSU-06 and 
0.24 K in AMSU-18. In general, the largest differences between LBL models are seen in 
AMSU-18, the water vapor channel. A large STD of 1.35 K is seen in AMSU-14 for 
RTTOV-5 and 6 (see below for explanation). 

Fig. 6 shows the BT difference in the four AMSU channels between various MW models 
and CIMSS MWLBL as a function of profile number. In AMSU-06, ATM has a 
systematic bias of about 0.5 K. RAYTHEON appears deficient in that channel, with 
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highly variable BT differences. Other models are very close, typically within 0.1 K STD. 
In AMSU-10, RTTOV-6 and RAYTHEON display similar difference characteristics, 
with amplitudes as large as 0.7 K. Differences do not seem related to the type of profile. 
In AMSU-14, OPTRAN has a negative bias of about 2 K, which was eventually traced 
back to instability in the regression in one of the top layers. RTTOV-5 and 6 have 
occasional large positive differences (up to 4 K) in some profiles. The largest differences 
occur in atmospheric profiles with the largest temperature gradients in the stratosphere 
(between 10 hPa and 0.5 hPa, the temperature increases by more than 45 K for 
atmospheres such as 3, 5, 12, 13 and 24). The reason for this difference is thought to be 
due to the inclusion of the Zeeman effect for RTTOV-5 and 6 which only manifests itself 
for profiles with large temperature gradients in the stratosphere as top of atmosphere 
radiances are only sensitive to transmittance differences where the layers are not 
isothermal. RTTOV was the only model that included this effect and so simulations were 
performed using the MSCMWLBL model (which is the LBL model on which RTTOV is 
based in the microwave) with and without the Zeeman effect included. The results 
showed that a mean bias of 0.4, STD of 1.1 K and maximum difference of 3.2 K is 
obtained for the differences in the profile set when the effect is included or not which 
explains the larger differences for RTTOV seen in Table 8 and Fig. 6 for AMSU-14. For 
the other AMSU channels the effect is negligible. For OPTRAN the profiles with large 
stratospheric temperature gradients also show differences, but of opposite sign. The 
spread among models is more uniform in AMSU-18, with the largest differences for 
models ATM, RTTOV-6, MSCMWLBL and RAYTHEON in the three driest 


atmospheres: 8, 40 and 42. 
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5.2 Jacobians and transmittances 

Figure 7 shows examples of MW Jacobians and Table 9 lists values of M computed with 
respect to CIMSSMWLBL. As seen in Fig. 7, RAYTHEON differs the most in AMSU- 
06, leading to a value of M near 1 1 due to higher Jacobian values above 300 hPa. In all 
four panels of Fig. 7, the MIT Jacobian appears slightly shifted downward compared to 
other models. A more subtle deficiency is noted for the AER models in the AMSU-06 
Jacobian, with small oscillations which are likely due to the vertical interpolation (also 
noticeable in the AMSU-18 H 2 0 Jacobian). RTTOV-6 is clearly an outsider in AMSU- 
14 because it considers the Zeeman effect as explained above. MIT and OPTRAN 
Jacobians are both placed lower in the atmosphere, resulting in relatively high M values. 
In AMSU-18, the AER OSS and AERLBL model Jacobians peak lower than the others 
by about 40 hPa, resulting in values of M of about 14 for the T Jacobian and 27 for the 
H 2 0 Jacobian. The H 2 0 Jacobian peak is less sharp and displays a distinctly lower 
magnitude (0.18 K vs 0.30 K). A relatively good agreement in BT does not always 
transfer into a good agreement in the Jacobians. This apparent contradiction is resolved if 
the cause of the differences is identified as the vertical interpolation of the Jacobian. Only 
a complete examination covering BTs, Jacobians and transmittances gives confidence on 
the robustness and correct physical behavior of a given model under all circumstances. 

Figure 8 shows total optical depth scatter plots for AMSU-14 with AER LBL as 
reference. Each group of points represents the optical depth from a given level to the 
TOA for the first eight levels (Table 4). The uniform oxygen concentration causes 
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discrete grouping of the optical depth values. Optical depths near 4.0 correspond to those 
from the 8 lh level near 10 hPa, those near 3.0 are from the 7 th level near 7 hPa and so on. 
For all models the scatter is small. RTTOV-5 and RTTOV-6 are characterized by higher 
optical depths (due to the inclusion of the Zeeman effect) while the reverse is true for 
OPTRAN. For these models, a simple linear adjustment would not be sufficient to align 
with the reference since the pattern is not linear. As expected, AEROSS follows 
AERLBL very closely. MSCMWLBL is also in line with AERLBL. CIMSS MWLBL 
has slightly lower optical depth, as does RAYTFIEON and MIT. ATM optical depths 
diverge noticeably from AER LBL values as the optical depth increases. 

6. Conclusion 

There is a need to better understand the strengths and limitations of current RTMs. This 
study addressed that issue by inviting scientists to provide modeling results for a 
representative ensemble of HIRS and AMSU channels. BTs, transmittances and 
Jacobians were evaluated. The main results can be summarized as follows. 

• IR LBLs typically agree between themselves to within 0.05-0.15 K in TOA BT. The 
same applies to MW LBLs except for one model in AMSU- 14 and 18. However, 
systematic HIRS and AMSU biases as large as 0.5 K were noted. 

• Differences among IR LBLs are often largest for warmest and wettest atmospheres, 
notably for HIRS- 10, 12 and 15. A detailed study on the air-mass dependence of bias 


remains to be done. 
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• IR NB models do not necessarily perform better than BB models because they are not 
tuned to fit an LBL. Similarly, BB models not tuned to an LBL, but rather to a NB 
model (for convenience reasons), are at a disadvantage. Clearly, close links between 
BB and LBL modelers are necessary. Parameterizations which vary slowly with 
wavelength, such as those for the H 2 0, 0 2 and N 2 continua can be implemented in 
BB models in a manner very similar to that in the LBL model. 

• The desired accuracy of 0.25 K STD or better for fast IR models is achieved in 
various channels by various models, but no individual model reaches that level of 
accuracy in all channels. Since NWP centers prefer to rely on a single RTM in data 
assimilation, some combination of the best modeling approaches appears desirable. 

• Fast MW models can reproduce the corresponding LBL results with an accuracy of 
0.10 K STD in all air-masses. In the microwave, the main issue is therefore the 
accuracy of the LBL models. 

• The Jacobian study proved very useful in detecting bugs and potentially important 
inconsistencies. In general, Jacobians are quite smooth. The presence of kinks often 
points to known dangers of regression such as out-of-limits profiles (e.g. very low 
humidity in the stratosphere). Guaranteed continuity in level-to-TOA transmittance is 
important. The models need to be able to reproduce the amplitude and level of 
maximum amplitude of the Jacobian:. 

• The interpolation between calculation and output levels creates Jacobian errors which 
may have important consequences. 

• Examination of optical depth scatter plots pertaining to specific gases reveals detailed 
information on the nature of differences between models. It identifies the gas most 
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responsible for the differences. The magnitude and shape of the scatter is indicative 
of the potential accuracy. A nonlinear difference pattern implies a need fot major 
changes to the transmittance formulation. 

Other intercomparisons similar to this one will be needed for the evaluation of fast 
models pertaining to narrow IR channels such as those soon to be available from IASI 
(Infrared Atmospheric Sounding Interferometer, scheduled for 2005, -8,000 channels at 
0.25 cm' 1 ) or AIRS (Atmospheric Infrared Sounder, scheduled for 2001, -2,370 channels 
at 1 cm’ 1 ). We recommend for such future intercomparisons: 

a) to get transmittance and Jacobians pertaining to all active gases 

b) to extend the validation to at least another viewing angle such as 60 degrees (the 
maximum angle for cross-scanners or geostationary satellite retrievals) 

c) to extend the validation to downward radiances in order to evaluate separately the 
surface reflection term (surface emissivity non unity, with spectral variation) 

d) to compute if possible some channel BTs on global maps at reduced spatial resolution 
in order to better identify air-mass dependent biases 

Desirable characteristics of fast models include: 

a) an accuracy of 0.25 K or better in all channels (or instrument noise level if it is 
greater) 

b) minimization of air-mass dependent biases 

c) specific transmittance profiles and analytical Jacobians for all active gases 

d) direct calculations on any vertical coordinate 


e) easy adaptation to new instrument characteristics 


From the LBL modeling viewpoint, efforts should be made to better understand TOA BT 
differences among models in excess of 0. 1 5 K. One area of uncertainty remains the water 
vapor continuum. Since this parameterization attempts to match observed and modeled 
spectra, it will differ for LBL models which treat the wings and/or shapes of the 
absorption lines differently. In other words, the treatment of lines and continua requires 
consistency. Another requirement, of a more practical nature, is the development of 
faster LBL models of sufficient accuracy and speed to meet the ever increasing demand 
for reference calculations. Because only a handful of individuals maintain LBL codes, 
common sets of profiles should be defined, and LBL computations on these profiles 


advertised and shared. 
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Figure captions 


Fig. 1 BT difference (K) between selected fast models (identified by symbols) and 
GENLN2 as a function of the atmospheric profile number for HIRS 2, 5, and 9-12. 

Fig. 2 BT difference (K) between IR LBL models (identified by symbols) and GENLN2 
as a function of the atmospheric profile number for the seven HIRS channels. 

Fig 3. HIRS-05 T, HIRS-09 Oj, HIRS- 10 and HIRS-1 1 H 2 0, and HIRS- 15 T Jacobian 
profiles for the various IR models applied to atmospheric profile 30. 

Fig. 4. HIRS-05 (a) and HIRS-09 (b) ozone TOA transmittance for various infrared 
models and atmospheric profile 30. For reference, the GENLN2 surface to TOA 0 3 
transmittance is 0.958 in HIRS-05 and 0.616 in HIRS-09. 

Fig. 5 Scatter plot of HIRS-1 1 GENLN2 TOA optical depths versus those of the other 
IR models obtained from all profiles and levels. 

Fig. 6. BT difference (K) between microwave models and CIMSS MWLBL as a 
function of the atmospheric profile number for the 4 AMSU channels. RTTOV-5, similar 
to RTTOV-6, is not shown (for all channels) as well as MIT (4 K bias) for AMSU- 18. 

Fig. 7. AMSU-06, 14 and 18 T Jacobian and AMSU- 18 H 2 0 Jacobian profiles for the 
various MW models applied to atmospheric profile 30. 

Fig-8 . Scatter plot of AMSU- 14 AER LBL TOA optical depths versus those of the other 
MW models obtained from all profiles and levels. 
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Table 1. NOAA-14 HIRS channel characteristics. Channel center wavenumber (v) and 
wavenumber range (approximately where normalized response function drops to 0.5). 
Instrument noise equivalent NEAT (pre-launch estimate at 280 K). Absorbing gases are 
listed in decreasing order of importance. Top-of-the-atmosphere brightness temperature 
range for the 42 atmospheres used in this study (based on GENLN2). 


HIRS 

ch 

V 

cm 1 

NEAT 

K 

v range 
cm' 1 

gases 

BT range 
K 

2 

679 . 36 

0 . 44 

672-686 

CO_: , H;>0 , O j 

208-239 

5 

714 .50 

0 . 09 

704-724 

co 2 ,h 2 o,o 3 

225-249 

9 

1028 . 31 

0 . 03 

1013-1042 

o 3 ,h 2 o,co 2 

235-295 

10 

796 . 04 

0 . 07 

787-805 

h 2 o , o 3 , co 2 

242-305 

11 

1360 . 95 

0 . 11 

1340-1382 

h 2 o , ch 4 , co 2 

238-268 

12 

1481.00 

0 . 30 

1441-1523 

h 2 o,o 2( ch 4 

231-253 

15 

2236 .39 

0 . 06 

2225-2248 

co 2 ,n 2 o,n 2/ h 2 o 

227-263 
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Table 2. NOAA-15 AMSU channel characteristics. Center frequency (v, GHz), first and 
second side bands (sidel, side2, GHz) /and half-bandwith (h-band, MHz). Instrument 
equivalent noise NEAT (K, pre-launch measurement). Absorbing gases listed by 
decreasing order of importance. TOA BT range (K) for the 42 atmospheres used in this 
study (AERLBL model) 


AMSU 

V 

sidel 

side2 

hband 

NEAT 

gases 

BT range 

6 

54 .40 

0 . 000 

0 . 000 

190 . 3 

0 . 15 

0 2 , H 2 0 

217-245 

10 

57 .29 

0 .217 

0 . 000 

38.29 

0 .25 

0 2 ,h 2 0 

204-236 

14 

57.29 

0 . 322 

0 . 005 

1.465 

0 . 91 

o 2 , h 2 o 

226-272 

18 

183 .31 

1 . 000 

0 .000 

250 . 0 

1 . 06 

h 2 o,o 2 

220-262 
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Table 3. Atmospheric profile characteristics in terms of surface temperature T s , 
integrated water content IWC, integrated ozone amount IOC, and mean atmospheric 
temperature Tb ar . 


Prof. 

T s 

IWC 

IOC 

Tbar 

Prof. 

T s 

IWC 

IOC 

Tbar 

No 

(K) 

(kg/m2) 

(DU) 

(K) 

No 

(K) 

(kg/m2) 

(DU) 

(K) 

1 

299.7 

40.7 

276.3 

258.3 

22 

314.8 

19.6 

268.6 

264.5 

2 

294.2 

29.1 

330.5 

258.1 

23 

299.5 

22.01 

231.1 

259.9 

3 

272.1 

8.3 

373.7 

244.6 

24 

281.7 

33.9 

230.7 

255.6 

4 

287.4 

21.0 

343.5 

254.0 

25 

292.4 

37.3 

270.6 

255.7 

5 

257.2 

4.1 

371.2 

237.6 

26 

296.9 

45.0 

255.8 

258.2 

6 

288.2 

14.1 

340.2 

250.4 

27 

301.4 

52.2 

270.7 

259.8 

7 

247.3 

3.1 

205.8 

227.5 

28 

301.8 

59.9 

255.7 

260.4 

8 

242.9 

0.6 

484.0 

232.2 

29 

298.4 

61.5 

217.9 

259.2 

9 

258.1 

8.3 

334.2 

236.8 

30 

301.6 

70.9 

239.1 

260.7 

10 

258.1 

3.0 

320.6 

238.2 

31 

250.5 

1.7 

222.5 

232.4 

11 

275.8 

7.0 

355.7 

242.5 

32 

299.4 

26.6 

255.2 

259.9 

12 

277.7 

9.7 

343.7 

243.1 

33 

296.3 

37.3 

276.4 

257.6 

13 

280.0 

9.9 

272.4 

246.1 

34 

283.6 

12.0 

286.5 

247.0 

14 

284.3 

15.2 

364.1 

251.6 

35 

273.3 

7.7 

317.0 

244.9 

15 

284.7 

26.0 

262.7 

254.0 

36 

254.2 

3.7 

338.4 

238.0 

16 

285.9 

16.6 

242.3 

256.5 

37 

261.6 

5.2 

371.3 

241.1 

17 

302.5 

51.1 

235.9 

259.8 

38 

270.7 

3.8 

384.3 

237.0 
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18 

315.9 

33.1 

271.3 

263.9 

19 

252.2 

2.4 

492.7 

234.5 

20 

290.9 

10.2 

235.0 

258.1 

21 

285.1 

12.9 

331.1 

248.7 


end of table 3 


39 

254.1 

2.3 

417.9 

234.8 

40 

249.2 

0.8 

449.2 

236.2 

41 

253.3 

2.0 

470.8 

237.0 

42 

255.4 

0.7 

494.8 

235.3 
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Tabic 4. The vertical coordinate defined by 43 pressure levels. 


level 

P (hPa) 

level 

P (hPa) 

1 

0.10 

12 

35.11 

2 

0.29 

13 

45.29 

3 

0.69 

14 

56.73 

4 

1.42 

15 

69.97 

5 

2.61 

16 

85.18 

6 

4.41 

17 

102.05 

7 

6.95 

18 

122.04 

8 

10.37 

19 

143.84 

9 

14.81 

20 

167.95 

10 

20.40 

21 

194.36 

11 

27.26 

22 

222.94 


level 

P (hPa) 

level 

P (hPa) 

23 

253.71 

34 

702.73 

24 

286.60 

35 

749.12 

25 

321.50 

36 

795.09 

26 

358.28 

37 

839.95 

27 

396.81 

38 

882.80 

28 

436.95 

39 

922.46 

29 

478.54 

40 

957.44 

30 

521.46 

41 

985.88 

31 

565.54 

42 

1005.43 

32 

610.60 

43 

1013.25 

33 

656.43 
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Table 5. Model characteristics. Contributing agency (“from” column) designated by 
number in author’s list. Bands are either infrared (IR) or microwave (MW) or both. Type 
is broadband (BB), narrow-band (NB) or line-by-line (LBL). Transmittance formulation 
(form) is either regression (RG) or physical (PH). Jacobian (Jac) is either computed 
analytically (AN) or by the perturbation method (P). “Cont” refers to a version of the 
infrared H 2 O continuum (C2.1 means CKD2.1, Clough et al, 1989). “Base” is either the 
LBL reference model for fast models or the spectroscopic database (H96: HITRAN-96, 
Rothman et al, 1998; G97: GEISA-97, Jacquinet-Husson et al, 1997). 


No 

Model 

From 

Bands 

Type 

Form 

Jac 

Cont 

base 

Main reference 

1 

RTTOV-5 

13 

IR 

BB 

RG 

AN 

C2 . 1 

18 

Saunders et al (1999) 

2 

RTTOV-6 

13 

IR 

BB 

RG 

AN 

C2 . 1 

18 

Saunders et al (1999) 

3 

OPTRAN 

11 

IR 

BB 

RG 

AN 

C2 .2 

19 

McMillin et al (1995) 

4 

OPTRAN2 

11 

IR 

BB 

RG 

AN 

C2 .2 

18 

McMillin et al (1995) 

5 

OP-LRTM 

11 

IR 

BB 

RG 

P 

C2 .2 

19 

McMillin et al (1995) 

6 

OP-GLN2 

11 

IR 

BB 

RG 

P 

C2 .2 

18 

McMillin et al (1995) 

7 

MSCFAST 

1 

IR 

BB 

PH 

AN 

C2 . 1 

17 

Garand et al (1999) 

8 

MSCFAST2 

1 

IR 

BB 

PH 

AN 

C2 . 1 

17 

Garand et al (1999) 

9 

MALKMUS 

7 

IR 

BB 

PH 

AN 

C2 .2 

H96 

Engelen and Stephens (199 

10 

GLATOVS 

7 

IR 

BB 

RG 

AN 

C2 . 1 


Susskind et al (1983) 

11 

HFFP 

10 

IR 

BB 

RG 

P 

C2 . 1 

H92 

Joiner et al (1998) 

12 

SIMRAD 

9 

IR 

NB 

RG 

P 

none 


Weinreb et al (1981) 

13 

STREAMER 

14 

IR 

NB 

PH 

P 

none 

H92 

Key (1997) 

14 

MODTRAN 

3 

IR 

NB 

PH 

P 

C2 . 1 

H92 

Berk et al (1989) 

15 

SYNSATRAD 

6 

IR 

LBL 

PH 

P 

C2 .2 

H96 

Tjemkes and Schmetz (1997 

16 

4A 

15 

IR 

LBL 

PH 

AN 

C2 . 1 

G97 

Tournier et al (1995) 

17 

FLBL 

2 

IR 

LBL 

PH 

P 

C2 . 1 

H96 

Turner (1995a, b) 

18 

GENLN2 

13 

IR 

LBL 

PH 

P 

C2 . 1 

H96 

Edwards (1992) 

19 

LBLRTM 

16 

IR 

LBL 

PH 

P 

C2 .2 

H96 

Clough and Iacono (1995) 

20 

RTTOV-5 

13 

MW 

BB 

RG 

AN 

— 

28 

Saunders et al (1999) 

21 

RTTOV-6 

13 

MW 

BB 

RG 

AN 

— 

28 

Saunders et al (1999) 
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22 

OPTRAN 

11 

MW 

23 

AER_OSS 

4 

MW 

24 

MIT 

10 

MW 

25 

RAYTHEON 

8 

MW 

26 

CIMSS_MWLBL 

16 

MW 

27 

AERLBL 

4 

MW 

28 

MSCMWLBL 

1 

MW 

29 

ATM 

12 

MW 


BB 

RG 

AN 

26 

BB 

RG 

AN 

27 

BB 

RG 

P 

H92 

BB 

RG 

P 

— 

LBL 

PH 

P 

H92 

LBL 

PH 

P 

H92 

LBL 

PH 

P 

— 

LBL 

PH 

P 

H96 


McMillin et al (1995) 
Rosenkranz (1998) 
Rosenkranz (1995) 

Falcone et al (1979) 
Rosenkranz (1995) 
Rosenkranz (1998) 

Liebe (1989, et al 1992) 
Pardo et al (2001a, b) 


End of Table 5 


ON 

m 




SYNSATRAD 0.16 -0.25 0.14 -0.21 0.58 0.49 0.03 0.04 0.13 0.05 0.06 0.11 
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Table 7. Goodness of fit measure A/ (no units) for temperature (T), ozone (O 3 ) or water vapor 
(H 2 O) Jacobians for atmospheric profile 30 in HIRS channels. GENLN2 was used as reference. 
Values above 25 are in bold. 



H- 

02 

H- 

05 

H- 

05 

H- 

09 

H 

-09 

H- 

09 H 

-10 

H 

-10 

» H 

-11 

H- 

-11 

H 

-12 

H- 

-12 

H- 

-15 

model 

T 


T 


O 

3 

T 


h 2 

O 

O 3 

i 

T 


H : 

2 o 

T 


H 

2 O 

T 


H : 

>0 

T 


RTTOV-5 

3 

. 3 

4 

. 5 

24 

. 6 

10 

. 5 

2 

. 9 

21 . 

8 

8 

.3 

12 

. 1 

8 

. 0 

16 . 

5 

17 

. 8 

15 . 

6 

2 

. 7 

RTTOV-6 

2 

. 9 

4 

. 4 

23 

. 8 

10 

. 0 

3 

. 0 

21 . 

5 

8 

. 3 

12 

. 1 

8 

.0 

16 . 

6 

17 

. 8 

15 . 

6 

2 , 

. 7 

OPTRAN 

4 

. 6 

6 

. 8 

30 

. 6 

7 

. 8 

5 

. 2 

226 . 

1 

7 

. 8 

2 

. 9 

4 

. 5 

13 . 

0 

8 

. 2 

20 . 

6 

5 , 

. 8 

OPTRAN2 

2 

. 5 

4 

. 9 

46 

.4 

21 

. 9 

5 

. 4 

30 . 

7 

7 . 

. 6 

3 

. 0 

4 

. 0 

5 . 

0 

6 

. 9 

8 . 

4 

2 , 

. 4 

OP-GNLN2 

7 

. 9 

20 

. 9 

121 

.6 

7 

. 3 

3 

.4 

60 . 

7 

6 , 

. 3 

3 

.4 

23 

. 6 

20 . 

7 

7 

.2 

12 . 

9 

5 , 

. 8 

OP-LRTM 

3 

. 0 

7 

. 1 

28 

. 0 

8 

. 1 

4 

. 7 

138 . 

5 

6. 

. 1 

3 

. 1 

21 

.2 

21 . 

6 

8 

. 0 

12 . 

5 

7 , 

. 2 

MSCFAST 

11 

. 9 

6 

. 5 

13 

. 9 

6 

. 1 

8 

. 4 

18 . 

9 

1. 

. 8 

1 

. 8 

5 

. 4 

6 . 

8 

8 

. 0 

9 . 

2 

7 . 

. 7 

MSCFAST2 

3 

. 7 

6 

. 0 

13 

. 7 

7 

. 3 

5 

. 9 

13 . 

1 

1 . 

. 8 

1 

. 8 

5 

. 4 

6 . 

8 

8 

. 0 

9 . 

2 

7 , 

. 7 

MALKMUS 

9 

. 1 

7 

. 1 

29 

.4 

16 

. 5 

13 

. 3 

30 . 

5 

16 . 

. 1 

11 

. 8 

11 

. 1 

10 . 

9 

10 

. 9 

14 . 

1 

9 . 

. 1 

GLATOVS 

14 

. 4 

24 

. 4 

25 

.0 

22 

. 1 

21 

. 3 

70 . 

4 

23 . 

. 5 

26 

.2 

8 , 

. 2 

22 . 

3 

7 

. 4 

16 . 

6 

10 . 

. 7 

HFFP 

7 

. 9 

16 

. 0 

9 

. 7 

57 

.3 

78 

.8 

19 . 

1 

41 . 

.0 

60 

.7 

6 . 

. 3 

10 . 

1 

8 . 

. 8 

10 . 

3 

3 . 

, 3 

STREAMER 

-• 

-- 

- 

-- 

- 

-- 

18 

. 6 

11 

. 7 


- 

4 . 

. 8 

2 

. 3 

13 . 

.4 

17 . 

5 

9 , 

.4 

8 . 

1 

-- 

-- 

SYNSATRAD 

2 

. 9 

6 

. 3 

20 

.4 

4 

. 2 

3 

. 6 

3 . 

0 

1 . 

, 9 

1 

. 0 

3 . 

. 8 

2 . 

6 

6 . 

. 4 

5 . 

0 

-- 

-- 

MODTRAN 

3 

. 9 

12 

. 9 

15 

.2 

16 

.3 

19 

. 1 

9 . 

2 

11 . 

, 0 

15 

.8 

4 . 

. 7 

3 . 

7 

7 . 

. 0 

4 . 

3 

5 . 

2 

FLBL_00 

6 

. 4 

10 

. 8 

2 

. 6 

8 

. 5 

1 

. 4 

2 . 

7 

2 . 

, 1 

1 

. 7 

4 . 

.0 

6 . 

4 

8 . 

. 3 

11 . 

8 

9 . 

3 

LBL4A_00 

7 

. 3 

8 

.2 

16 

. 5 

11 

.5 

12 

. 5 

12 . 

3 

9. 

5 

11 

.3 

16 . 

.6 

17 . 

9 

27 . 

,0 

00 

CN 

4 

7 . 

0 

LBLRTM 

4 

. 7 

7 

. 7 

3 

. 8 

8 

. 3 

4 

. 7 

0 . 

7 

2 . 

2 

2 

. 7 

4 . 

. 4 

4 . 

2 

8 . 

.2 

5 . 

4 

8 . 

6 
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Table 8. BT standard deviation (K, first line) and bias (K, second line) of various models against 
CIMSS MWLBL for the 4 microwave channels. STDs above 0.25 are in bold. 



AMSU-06 

AMSU-10 

AMSU-14 

AMSU-18 

Model 

std 

bias 

std 

bias 

std 

bias 

std 

bias 

RTTOV-5 

0.04 

-0.05 

0.14 

0.25 

1.35 

0.91 

0.60 

-0.16 

RTTOV-6 

0.04 

-0.05 

0.14 

0.25 

1.35 

0.91 

0.28 

-0.38 

OPTRAN 

0.09 

0.00 

0.05 

-0.04 

0.73 

-1.97 

0.10 

0.00 

AEROSS 

0.06 

0.13 

0.04 

0.03 

0.09 

0.14 

0.14 

-0.16 

MIT 

0.01 

0.00 

0.04 

-0.04 

0.08 

-0.09 

0.19 

-0.40 

RAYTHEON 

0.42 

-0.57 

0.17 

0.24 

0.20 

0.60 

0.50 

-0.07 

AERLBL 

0.06 

0.13 

0.05 

0.03 

0.09 

0.16 

0.14 

-0.15 

MSCMWLBL 

0.03 

0.05 

0.03 

0.04 

0.20 

0.51 

0.32 

-0.36 

ATM 

0.19 

0.46 

0.07 

0.08 

0.11 

0.23 

0.24 

-0.28 
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Table 9. Goodness of fit measure M (no units) of temperature (T) or water vapor (H 2 0) 
Jacobians for the various microwave models applied to atmospheric profile 30 in each of the four 
AMSU channels (6, 10, 14 and 18). CIMSS_MWLBL is used as reference. Values above 25 are 
in bold. ATM Jacobians data not available. 



A- 06 

A- 10 

A- 14 

A- 18 

A-18 

model 

T 

T 

T 

T 

h 2 o 

RTTOV-5 

0 . 6 

2.4 

28.6 

2 . 0 

7 . 1 

RTTOV-6 

0 . 6 

2 .4 

28.6 

3 .3 

1.7 

OPTRAN 

2.7 

1 . 7 

17 . 5 

1 . 7 

0 . 6 

AER_OSS 

2 .4 

3 . 9 

9 . 5 

13 . 5 

26.5 

MIT 

6 . 2 

12 . 8 

25.7 

19.4 

20.3 

RAYTHEON 

10 . 7 

3 . 8 

7 . 5 

3 . 8 

10 . 0 

AER_LBL 

2 . 5 

3 . 6 

8.4 

13 . 5 

26.6 

MSCMWLBL 

0.4 

0 . 6 

5 . 1 

3 . 0 

1 . 6 
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